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Abstract 

Introduction: The inefficacy of clinical skill education during the clerkship has 
been reported in several studies. The present study was conducted to evaluate 
the competency of medical students in performing several clinical skills through 
an Objective Structured Clinical Examination (OSCE), aiming to evaluate the 
quality of the existing curriculum in the clerkship phase. 
Material and methods: The cross sectional study was conducted at the end of 
the clerkship period, before the students had entered the internship. The OSCE 
exam was conducted in the morning (2 different tracts) and in the evening 
(2 similar tracts) and 86 students participated in the exam. Each tract consisted 
of seven stations. The students' points in the stations assessing history taking 
and clinical skills were compared. 

Results: The students gained the highest points in the history taking stations, 
whereas the procedure stations accounted for the lowest points; there was a sig- 
nificant difference between these stations (p < 0.001). The female students 
achieved higher scores in the OSCE exam compared to males (p = 0.004). 
Conclusions: The OSCE exam revealed the inefficacy of the current medical cur- 
riculum in teaching the required clinical skill to undergraduate medical students 
during the clerkship. 

Key words: Objective Structured Clinical Examination, clinical exam, history taking, 
procedure, station, clerkship. 



Introduction 

Skillful performance in the act of medical care is fundamental for pro- 
viding patients with precise and professional health care. The patient 
expects physicians to diagnose his/her problem accurately, prescribe 
a suitable and effective treatment, while maintaining an acceptable and 
humanitarian relationship with him/her [1]. 

Clinical skills, therefore, are considered as the core competencies, indicat- 
ing that the essential goal of medical education is to ensure that each student 
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can perform such skills precisely throughout his/her 
professional life [2, 3]. 

Learning clinical skills is a time-consuming and 
gradual process. Clerkship is the time in which stu- 
dents have to learn and practice various clinical 
skills. In recent years, however, the adverse insti- 
tutional, economic and regulatory authorities have 
diminished the quality of teaching such skills [3]. 

Many studies have evaluated the competency 
of clerkship students in performing clinical skills in 
order to ascertain the deficiencies and help author- 
ities make the necessary changes in the curriculum 
[4, 5]. The majority of them reported that these 
techniques are not systematically taught or com- 
prehensively evaluated during the undergraduate 
education [6-8]. 

In our country, similarly, inefficacy of clinical skill 
education during the clerkship has been reported 
in several studies [9, 10]. Except for the study con- 
ducted in Shiraz University of Medical Sciences, 
they have used questionnaires and self assess- 
ments to evaluate the students' competency in per- 
forming such skills [11]; in other words, not much 
is performed regarding the paradigm of the quali- 
ty of medical education and the learner's perfor- 
mance outcome in our country. 

The present study was, therefore, conducted to 
evaluate the competency of medical students in 
performing certain clinical skills through an Objec- 
tive Structured Clinical Examination (OSCE) - con- 
sidered as an acceptable examination technique in 
evaluating the performance and competence in 
clinical skills. In other words, the present study 
aimed to evaluate the quality of the existing cur- 
riculum in teaching communication, clinical exam- 
ination, medical procedures/prescription, and inter- 
pretation of results [12], during the clerkship. 

Material and methods 

After being approved by the ethical board com- 
mittee of Tehran University of Medical Sciences, 
the cross sectional study was conducted on all the 
undergraduate medical students who had just fin- 
ished their clerkship, and were intending to start 
internship in a short time. The university asked the 
students to participate in the exam, confirming that 
while the OSCE scores would not have any nega- 
tive effects, those with the highest scores would 
be given bonuses in the internship. 

In the first step, an OSCE committee consisting 
of the dean of the Medical University and clerkship 
phase along with the academic staff with practical 
experience in designing OSCE exams was establi- 
shed. The 16-member committee determined the 
date of the exam and the basic clinical skills need- 
ed to be evaluated in the exam based on the exist- 
ing curriculum, literature review [2, 11], AAMC 
clinical skills of clerkship [3], the complaints received 



by the Iranian Medical Council and the self assess- 
ments taken from the graduates regarding the ne- 
cessary and frequently used skills. It should be 
stressed that the authors decided to select the clini- 
cal skills based on all the above mentioned evidence 
as there was no written document pointing out the 
most important clinical skills an undergraduate stu- 
dent should know before entering the internship. 

Considering the limitations of the physical envi- 
ronment of the skill lab, the place in which the 
exam was supposed to take place, particularly the 
number of rooms, along with the fact that 7 is the 
minimum acceptable number of stations in each 
OSCE exam, the committee decided to hold the 
exam in two sessions (morning and afternoon), 
each time in two tracks. It was decided that the 
morning tracks would be different, whereas simi- 
lar stations were designed for the tracks of the 
afternoon exam. 

In order to cover the largest number of clinical 
skills possible in different fields and considering the 
amount of the undergraduate curriculum dedica- 
ted to each course, it was decided to design three 
stations in surgery, internal medicine, gynecology, 
and pediatrics, and a single station for ophthalmo- 
logy, ENT, infectious disease, orthopedics, urology, 
emergency medicine, dermatology, radiology and 
neurology. 

Each station was supposed to be 5 min long; 
a 1-minute delay was calculated for the gap be- 
tween the stations, during which the students were 
able to study the stations through the instruction 
placed on the station door. It was decided that the 
total score of each station would be 10 points. 
Accordingly, the stations - the candidate instruc- 
tions, the examiner instructions, the checklist, the 
simulated patient instruction (if required), and the 
equipment list -were designed (Table I). 

Several sessions, based on the station and the 
competency of the individual, were held to train the 
simulated patients and the tutors. The tutors were 
asked not to talk to the candidates and not to pro- 
vide them with any clues or feedback. The simula- 
ted patients, similarly, were asked to avoid giving 
additional information; they were also asked to fol- 
low the instructions given by the students instead 
of performing the learned procedures. 

Finally, the physical environment of the exam 
was designed concerning the station design. The 
candidate instructions were placed both on the door 
of the station and on the table in the station so that 
the student would be able not only to study the sta- 
tion at the time given between the stations but also 
to read through it for possible complexities during 
the exam. 

Certain folders containing the answer sheet, the 
guidelines of the exam and stickers marked with 
their codes were prepared for each student. The 
students were supposed to provide the tutors in 
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Table I. The competencies evaluated in different tracks 





1 


2 


3 4 


5 


6 


7 


Morning 1 


CXR 


NG tube insertior 


Angiokit Ear 


Abdomen 


Cranial nerves 


Diabetes 


Morning 2 


Growth rate 


Pap smear 


Catheterization Eye 


Back pain 


Cerebellum 


Abdominal pain 


Afternoon 


Blood test 


Foreign body 


Suturing Thyroid 


Mouth 


Meningitis 


Dermatology disease 


Category 


Interpretation 


Procedure 


Procedure Physical 


Physical 


Physical 


History taking 








examination 


examination 


examination 





each station with their sticker aiming to conceal 
the students' identity from the tutors. 

At the same time, the students were fully 
informed about the exams; they received several 
guidelines on the basis of how an OSCE exam is 
performed. Some additional points were also pro- 
vided for the applicants, aiming to encourage the 
active participation of the students. Considering 
religious issues, female students were asked to par- 
ticipate in the morning exam and the males were 
invited for the afternoon exam. 

Considering the fact that there was no signifi- 
cant difference between the pre-internship scores 
of the male and female students (p = 0.247), the 
girls were asked to participate in the morning exam 
while the boys attended the afternoon test. 

The exam was held on 4 October 2008; 46 stu- 
dents participated in the morning session and 
40 others in the afternoon shift. At the entrance, 
the students picked their folder, suggestive of the 
track they were going to participate in. An official 
was responsible to verify the identity of the stu- 
dents through checking their identity card. The stu- 
dents were then guided to the quarantine consi- 
dering their group. Three individuals were responsible 
for guiding the students during the exam and through 
the stations. 

Statistical analysis 

Following the exam, the student's score in each 
station, his/her total score in the OSCE exam, and 
the pre-internship score (the score obtained in the 
MCQ exam that all Iranian medical students take 
before entering the internship) were all entered in 
SPSS version 15 and analyzed. 

Results 

Eighty-six students participated in the exam. The 
cooperation rate (COR) was about 88.6%. The mean 
pre-internship score was 128.91 ±16.9, ranging from 
93 to 164 (total score 200). 

Considering the points achieved in each track, 
the mean score in the morning exam was 4.39 and 
4.44 whereas that for the afternoon exam was 3.90 
and 3.75 points. The highest score in the morning 
exams were 5.6 and 5.52, and for the afternoon 
exams were 4.9 and 4.5. The lowest scores, on the 
other hand, were 2.55 and 2.85 for the morning 
exams, and 2.65 and 1.7 for the afternoon. 



Some students were able to score all 10 points 
in the following stations: performing Pap smear 
(47.8%), inserting IV-line catheter (21.7%), exami- 
ning cerebellum (13%), interpreting laboratory tests 
(5%), examining cranial nerves (4.3%), drawing and 
interpreting weight charts (4.3%), and suturing 
(2.5%). Conversely, extracting a foreign body (20%), 
placing NG tube (8.9%), and performing Pap smear 
(4.3%) were among the stations in which some stu- 
dents could not obtain any points (0). 

All the stations had a difficulty index of about 
0.5; taking the history of a patient with abdominal 
pain (0.21) and inserting urinary catheter (0.26) 
were considered the most difficult stations, where- 
as performing Pap smear and examining cerebel- 
lum (0.71) were considered the easiest stations. All 
the stations, except for those designed to evaluate 
the competency in history taking in abdominal pain 
and dermatology disease, had an acceptable dis- 
criminative index (higher than 0.1). 

The students gained the highest points in the 
history taking stations (6.73 ±1.83), whereas the 
procedure stations accounted for the lowest points 
(4.98 ±1.86); there was a significant difference be- 
tween these stations except for the ones on phys- 
ical examination and interpreting laboratory tests 
(Table II). 

There was a strong positive association between 
the points achieved in the OSCE exam and the stu- 
dent's pre-internship exam score (p < 0.001). The 
Pearson correlation revealed a positive but weak 
correlation between the pre-internship score and 

Table II. Comparing the students' competency in dif- 
ferent stations 



Parameter 


Mean ± SD 


Value of p 


History taking 
- Physical examination 


6.73 ±1.83 
6.26 ±1.27 


0.470 


History taking 
- Interpretation 


6.73 ±1.83 
5.95 ±2.24 


0.018 


History taking 
- Procedure 


6.73 ±1.83 
4.98 ±1.86 


< 0.001 


Physical examination 
- Interpretation 


6.26± 1.27 
5.95± 2.24 


0.238 


Physical examination 
- Procedure 


6.26± 1.27 
4.98± 1.86 


< 0.001 


Interpretation 
- Procedure 


5.95± 2.24 
4.98± 1.86 


0.002 
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Table III. The scores obtained in different types of stations based on the student's gender 
Variables Female (mean ± SD) Male (mean ± SD) Value of p 



History taking 7.47 ±1.5 

Physical examination 6.17 ±1.3 

Interpretation 5.94 ±2.4 

Procedure 5.65 ±1.8 



the score achieved in the OSCE exam (0.371, 0.212, 
respectively). 

The female students achieved significantly higher 
scores in the OSCE exam compared to males (4.32 
±0.7 vs. 3.88 ±0.6, p = 0.004); for the pre-intern- 
ship, however, male students' scores were non-sig- 
nificantly higher (127.86 ±16.4 vs. 130.43 ±17.6, 
p = 0.492). The female students reportedly obtained 
higher scores in stations designed to evaluate their 
competencies in history taking and performing cer- 
tain procedures (Table III). 

Discussion 

The present study showed that many of the 
undergraduate students do not have sufficient com- 
petency in performing the majority of clinical skills 
which they are in charge of during the internship. 
This is in line with the study performed in Shiraz 
University of Medical Sciences, which reported the 
incompetency of the students in performing clini- 
cal skills [11]. Based on its results, the average score 
of the clerks assessed through OSCE was half the 
total score [11]. Remmen et ai likewise assessed 
the competency of last-year medical students in 
performing 265 clinical skills through a question- 
naire and found that they could not rely on their 
learned material in performing procedures later on 
during the internship [13]. 

Fox et ai compared the competency of PRHOs 
(pre-registration house officers) in performing 
17 clinical skills through OSCE and questionnaire. 
They reported that the majority of these students 
are incapable of performing certain skills but nei- 
ther they nor their supervisors are aware of their 
deficiencies [14]. 

Ringested et ai similarly evaluated the compe- 
tency of the interns in doing clinical skills during 
the clerkship period through questionnaires. They 
reported that the undergraduate students' compe- 
tency was less than average in the majority of the 
cases; they therefore concluded that revising the 
curriculum with the aim of improving the clerkship 
competency in performing clinical skills was need- 
ed [15]. The present study also revealed that stu- 
dents obtained the highest score in stations de- 
signed to assess their competency in taking history 
and then in performing physical examination, whe- 
reas the stations designed to evaluate the compe- 
tency of procedures accounted for the lowest scores. 



5.66 ±2.1 < 0.001 

6.38 ±1.3 0.455 

5.97 ±2.4 0.951 

4.01 ±1.4 < 0.001 



This was in accordance with the fact that the stu- 
dents are frequently asked to take complete histo- 
ries and perform through physical examinations 
during clerkship in our country. During the intern- 
ship, however, they are responsible for performing 
certain clinical skills and procedures - rarely taught 
or exercised throughout the clerkship - all by them- 
selves and in the absence of any supervision. Amini 
et ai asked the interns studying in Tabriz University 
of Medical Sciences to evaluate their competency in 
performing certain procedures; the study revealed 
the majority of these undergraduate students to 
be incompetent in performing clinical skills. These 
students considered their capability in performing 
different clinical skills to be about 51.4%, adding 
that they had insufficient competency in perform- 
ing lumbar puncture, inserting tracheal and naso- 
gastric tubes, placing a splint, and extracting a for- 
eign body from the eye or ear, as they had learnt 
these skills through observation and practiced them 
in the absence of any supervision [16]. 

The girls obtained the highest score in the OSCE 
exam while the boys' score was higher in the pre- 
internship exam, indicating that girls perform better 
in clinical skills whereas boys are more competent 
in knowledge exams. This could be attributed to 
the fact that boys spend less time learning skills 
when their outcomes are not assessed. 

Considering the significant difference noted 
between the scores achieved in the OSCE exam and 
the pre-internship exam, it could be concluded that 
none of these exams can substitute one another 
in evaluating undergraduate medical students in 
our university. 

In conclusion, this study reported the incompe- 
tency of medical students in performing certain cli- 
nical skills during internship, indicating that there 
is a great need to revise the current curriculum in 
order to focus on clinical skill development during 
the medical education. 

Moreover, this exam provides reasonable evi- 
dence for the need of repeating a similar exam re- 
gularly at the end of the clerkship as well as at grad- 
uation time to confirm the competency of medical 
students entering the internship period and society. 

This OSCE exam was the first such exam, per- 
formed at the end of the clerkship period, aiming 
to evaluate the curriculum at this stage rather than 
the students' competency; as a result, the author- 
ities decided to provide some additional points to 
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encourage students to participate in the exam. Such 
a strategy may have motivated weaker students 
more than stranger ones to attend the examination. 
However, considering the high cooperation rate of 
the present study, a sampling bias is not applicable. 

Moreover, in deference to our country's segre- 
gation laws concerning educational environments, 
we had to ask the female students to attend the 
morning exam and the males to come in the after- 
noon. The stations designed for the morning and 
afternoon exams are believed to be similar regard- 
ing the competencies they assessed as well as their 
difficulty, but it would be a better idea to ask all the 
students to attend similar stations and thereafter 
evaluate the influence of gender on their scores. 
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